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Overview 


("Data compression 
(@Noisy-channel coding 
» Chs 1-6, 8-10, 14 
(inference, data modelling 
‘clustering, pattern recognition 
» Chs 20, 22 
@Probability toolbox 
© Monte Carlo methods 
+ Ch 29, 30, 32 
Variational methods 
» Ch 33 


(Neural networks 


» Chs 38, 39, (8 perhaps 41, 44), 42 
@State-of-the-art error-correcting codes 


Recommended exercises 


929.14, 33.5, 33.7, 27.1, 22.11, 39.4, 39.5 
Handouts 2, 3 (on website) 
© The 5 cards magic trick (15.6) 

80, 29, 10%, 90 


Additional reading 


@Laplace's method (Ch 27) 
sing models (Ch 31) 


The course 
www.inference.phy.cam.ac.uk/itprnn/ 


David J. C. Mackay 


Information Theory, inference, 
and Learning Algorithms 


The book 
www.inference.phy.cam.ac.uk/itila/ 


Monte Carlo methods 


("Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


(@Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 


Slice sampling 


@Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


(Exact sampling 
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Monte Carlo methods 


("Simple Monte Carlo methods 
Importance sampling 
Rejection sampling 


(@Markov-chain Monte Carlo methods 
Metropolis method 
Gibbs sampling 


Slice sampling 


@Reducing random-walk behaviour 
Hamiltonian Monte Carlo 
Overrelaxation 


(Exact sampling 


Problems with standard Monte Carlo methods 


@Random walk behaviour 

Efficient methods 
@Sensitivity to step size 

Slice sampling 


@When to stop 


Exact sampling 


Problems with standard Monte Carlo methods 


@Random walk behaviour 

Efficient methods 
@Sensitivity to step size 

Slice sampling 


@When to stop 


Exact sampling 


File Edit View Terminal Help 


=25:lewis:/home/mackay/itp/metrop> ./demo.p 
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20 iterations 


ee 
mp 


- ч da , alle | 
vC) "m 
li? ^ 
7$ кә wl |= (=) 


File Edit View Terminal Help 


=25:lewis:/home/mackay/itp/metrop> ./demo.p 
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20 iterations 


560 iterations 
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Efficient Monte Carlo methods 


Hamiltonian Monte Carlo 


Overrelaxation 
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Adler's Overrelaxation 


Adler's Overrelaxation 
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Gibbs sampling - x1 
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Adler's Overrelaxation - x1 
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Adler's Overrelaxation - x1 


Gibbs sampling - x112 
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Robust Monte Carlo methods 


Slice sampling 


Self-terminating Monte Carlo methods 


Exact sampling 


Exact sampling 


Hexagon 


Exact sampling 


Hexagon 


Exact sampling 


Exact sampling for the Ising model 
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5 2 See Ising models (Ch 31) 
Introduction to the Ising model 


N = 4096 Figure 31.4. Detail of Monte Carlo 
Li simulations of rectangular Ising 
models with J = 1. (a) Mean 


ын energy and fluctuations in energy 

as a function of temperature. (b) 

i Fluctuations in energy (standard 
" deviation). (c) Mean square 


magnetization. (d) Heat capacity. 


Exact sampling - Ising model at Тс 


Exact sampling - Ising model at Тс 


Exact sampling - Ising model at Тс 


Exact sampling - Ising model at Тс 


Problems with standard Monte Carlo methods 


@Random walk behaviour 

Efficient methods 
@Sensitivity to step size 

Slice sampling 


@When to stop 


Exact sampling 


Gibbs samplin 


@Not revealing the normalizing constant 
Thermodynamic integration 
Reversible-jump Markov chain Monte Carlo 
The acceptance ratio method 
Umbrella sampling 
Simulated tempering 
Tempered transitions (Radford Neal) 
Annealed importance sampling (Radford Neal) 
Linked importance sampling (Radford Neal) 


